System for collating data from multiple sources to form a composite program guide for display

ABSTRACT

A video decoder system collates program guide information acquired from a variety of local and remote sources. Program guide information is received from a first source and a selectable program guide menu icon is displayed. A category of program guide information items from the first source is collated by a display attribute in response to selection of the menu icon and the collated program guide information items are displayed. The display attribute allocated to the category of program guide information items is common to both the category of items and to the menu icon. Codes identifying program categories may be converted to other codes using equivalence mapping information for classifying programs according to a master set of program categories. Composite program map information may be formed including new data identifiers allocated to program guide information items for use in retrieving the items from a second source.

This application is a divisional of U.S. application Ser. No. 09/402,524filed Oct. 5, 1999 now U.S. Pat. No. 7,496,946, herein incorporated byreference.

FIELD OF THE INVENTION

This invention is related to the field of digital signal processing, andmore particularly to the acquisition, formation and processing ofProgram Guide Information, and program content data, derived frommultiple sources, e.g. Internet, cable, satellite and terrestrialsources.

BACKGROUND OF THE INVENTION

Home entertainment systems which combine Personal Computer andtelevision functions (PC/TV systems), are increasingly becoming,generic, User interactive, multiple source and multiple destinationcommunication devices. Such systems are required to communicate indifferent data formats between multiple locations for a variety ofapplications in response to User requests. For example, a PC/TV systemmay receive data from satellite or terrestrial sources comprising HighDefinition Television (HDTV) broadcasts, Multi-point MicrowaveDistribution System (MMDS) broadcasts and Digital Video Broadcasts(DVB). A PC/TV system may also receive and transmit data via telephone(e.g. the Internet) and coaxial lines (e.g. cable TV) and from bothremote and local sources such as Digital Video Disk (DVD), CDROM, VHSand Digital VHS (DVHS™) type players, PCs, and many other types ofsources.

A number of problems arise in developing such a generic PC/TVentertainment system. Specifically, problems arise in supportingcommunication between multiple data sources and in processing data fromthe multiple sources. A problem is also presented by the need to devisea User interface for such a system that supports complex Userinteractive tasks whilst providing a simple command interface suitablefor the general public. A PC/TV system User interface, for example,should allow a User to view a selected program and permit User operationof functions such as Email, telephone, Internet access, fax andvideo-phone functions. Such applications require communication between aPC/TV unit and a variety of both remote sources e.g. a satellite serviceprovider, and local sources e.g. a DVD storage device. Further, a PC/TVneeds to process and decode data in different data formats fromdifferent devices and display received data to the User. These problemsare addressed by a system according to the present invention.

SUMMARY OF THE INVENTION

The inventors have hereby recognized that a Program Guide type of Userinterface advantageously provides a simple, easy to use interface forUser operation of functions such as Email, telephone, Internet access,fax, home control, and video-phone functions. The use of a Program Guidefor such functions also advantageously provides a single User interfacefor User operation of multiple devices and associated functions.

The inventors have further recognized that it is desirable for a videodecoder system to be capable of collating program guide informationacquired from a variety of local and remote sources. Specifically, theinventors have recognized that the information may be advantageouslycollated into categories of items for display in accordance with a)allocated display attributes e.g. color, shading, or shape, b) allocateddata identifiers e.g. packet identifiers (PIDs), c) hierarchical programcontent structures e.g. a theme encompassing subtopics (such as moviesclassified by comedy, horror etc.), d) equivalence mapping informationthat maps a received set of program categories to a defined superset ofcategories, and e) characteristics including the source, function andcontent of a program guide item.

In a method for collating program guide information received from afirst source, a selectable program guide menu icon is displayed. Acategory of program guide information items from the first source iscollated by a display attribute in response to selection of the menuicon and the collated program guide information items are displayed. Thedisplay attribute allocated to the category of program guide informationitems is common to both the category of items and to the menu icon.

In a feature of the invention, composite program map information isformed including a new data identifier allocated to a program guideinformation item and the new identifier is used to retrieve the itemfrom a second source.

In another feature of the invention, a first code identifying a programcategory is converted to a second code using equivalence mappinginformation for classifying programs according to a master set ofprogram categories.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawing:

FIG. 1 shows a home entertainment decoder system, according to theinvention, for communicating with a plurality of sources and forprocessing program guide information and program content data.

FIG. 2 shows an exemplary Program Guide display format according to theinvention.

FIG. 3 shows a data format, according to the invention, for packetizingInternet data for transmission within an MPEG compatible datastream.

FIG. 4 shows a flowchart, according to the invention, for receivingprogram guide information including User selection options andprocessing the received information to form a program guide supportingUser selectable communication functions.

FIG. 5 shows a flowchart, according to the invention, for a process toform a program guide in a video decoder from information received from aplurality of sources.

FIG. 6 shows a flowchart, according to the invention, for a process toautomatically acquire and collate program guide information from aplurality of sources and to form a program guide for display.

FIG. 7 shows a black and white representation of an exemplary colorProgram Guide display format, according to the invention, showing menuoptions permitting a User to collate programs by source and colorattribute.

FIG. 8 shows a flowchart, according to the invention, for a process toacquire information requested by a video receiver User via a selectionmade from options on a displayed program guide.

FIG. 9 shows a flowchart, according to the invention, for a process todecode input Internet information and compressed video data and to forma composite video output for display.

DETAILED DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a home entertainment decoder system, according to theinvention, for communicating with multiple sources to acquire programguide information and program content data. The decoder system forms aprogram guide for display from information acquired and collatedautomatically from multiple sources. A User may initiate Email,telephone, Internet access, fax and video-phone functions via selectionof options from the displayed program guide. The decoder systemadaptively decodes a datastream encoded to the MPEG standardincorporating compressed program content data and Internet datarepresentative of, for example, Hypertext Mark-up Language (HTML). Thedecoded data is formatted either as a composite video image or asseparate video images for display.

The MPEG2 (Moving Pictures Expert Group) image encoding standard,hereinafter referred to as the “MPEG standard” is comprised of a systemencoding section (ISO/IEC 13818-1, 10 Jun. 1994) and a video encodingsection (ISO/IEC 13818-2, 20 Jan. 1995), hereinafter referred to as the“MPEG systems standard” and “MPEG video standard” respectively.

Although the disclosed system is described in the context of a systemfor receiving an MPEG compatible signal, it is exemplary only. Theprinciples of the invention may be applied to systems in which the typesof transmission channels and communication protocols may vary, or tosystems in which the coding type may vary. Such systems may include, forexample, non-MPEG compatible systems, involving other types of encodeddatastreams and other methods of conveying Program Guide information.Further, although the disclosed system is described as processingbroadcast programs, this is exemplary only. The term ‘program’ is usedto represent any form of data such as telephone messages, computerprograms, Internet data or other communications, for example.

In overview, in the video receiver system of FIG. 1, a carrier modulatedwith video data is received from a broadcast satellite by antenna 10 andprocessed by unit 15. The resultant digital output signal is demodulatedby demodulator 20 and decoded and error corrected by decoder 30. In thisexemplary embodiment, the demodulated and decoded output from unit 30 isin the form of an MPEG compatible transport stream containing MPEGcompressed video data and Internet data encoded in HTML. Video dataencoded to the MPEG standard is in the form of a packetized datastreamwhich typically includes the data content of many program channels (e.g.content corresponding to cable television channels 1-125).

The MPEG compatible transport stream is provided to processor 25 whichis responsive to commands from remote control unit 125. Processor 25communicates with other data sources including storage device 90 andeither Internet data server 83 or Internet connection service 87 (e.g.America On-line™). Program guide information is acquired and collatedautomatically from the input transport stream and storage device 90 andeither server 83 or connection service 87. The acquired information ismerged by processor 25 to form a program guide for display incorporatingselection options allowing a User to initiate Email, telephone, Internetaccess, fax and video-phone functions among others, for example. Theprogram guide for display is also formed to include non-displayedinformation from multiple sources for identifying and assemblingindividual data packets that constitute the programs that are selectedfor User viewing or listening. This information is used in recoveringthe content of selected programs from multiple sources.

Processor 25 adaptively decompresses the input compressed video data anddecodes the HTML Internet data to provide a formatted composite videoimage for display on unit 75. Processor 25 also provides encoded dataoutputs for storage on storage medium 105 via storage device 90, andprovides encoded data to other devices (not shown to simplify drawing)via modem 80 and telephone lines.

A video receiver user initiates functions including Email, telephone,Internet access, fax and video-phone functions and viewing and storageof selected programs via selection of options from the displayed programguide. A User selects a displayed option with a cursor using remotecontrol unit 125. Commands from remote control 125 are passed viainterface 120 to controller 115 within processor 25. Unit 115 controlsthe operation of the elements of processor 25 and responds to remotecontrol unit 125 commands using a bi-directional data and control signalbus C. Controller 115 controls the functions of individual elementswithin processor 25 by setting control register values within theseelements with control bus C. Processor 25 also supports the storage andretrieval of data from storage medium 105 via storage device 90. Storagedevice 90 is a DVD type device and medium 105 comprises a multi-diskstack unit containing a plurality of disks in this exemplary embodiment.

Considering FIG. 1 in detail, a carrier modulated with video datareceived by antenna 10, is converted to digital form and processed byinput processor 15. Processor 15 includes radio frequency (RF) tuner andintermediate frequency (IF) mixer and amplification stages fordown-converting the input video signal to a lower frequency band.Processor 15 also includes an analog to digital converter for digitizingthe down-converted signal to produce a signal suitable for furtherprocessing. The resultant digital output signal is demodulated bydemodulator 20 and decoded and error-corrected by decoder 30. The outputfrom decoder 30 is further processed by unit 45 of processor 25.

The data provided to unit 45 is in the form of an MPEG compliantpacketized transport datastream as defined in MPEG systems standardsection 2.4 and includes program guide information and the data contentof one or more program channels. Processor 25 acquires and collatesprogram guide information automatically from the input transport streamand storage device 90 and either Internet data server 83 or Internetconnection service 87 (e.g. America On-line™). The individual packetsthat comprise either particular program channel content, or ProgramGuide information, are identified by their Packet Identifiers (PIDs)contained within header information.

In response to control signal C, unit 45 selects either the transportstream from unit 30, or in a playback mode, a datastream retrieved fromstorage device 90 via store interface 95. In normal, non-playbackoperation, individual packets that comprise program guide informationare identified by unit 45 in the transport stream from unit 30 andassembled using PIDs that are predetermined and stored in internalmemory of controller 115. Unit 45 matches the PIDs of incoming packetsin the transport datastream from decoder 30 with PID values pre-loadedin control registers within unit 45 by controller 115. Therefore,satellite broadcast program guide (SPG) information packets in thetransport stream are identified by unit 45 without additional PIDinformation. Controller 115 acquires a full SPG by accessing andassembling the SPG packets that are identified and captured by unit 45.

The PID information that enables controller 115, in conjunction withunit 45, to identify data packets that comprise individual programs istermed a program or channel map. The program map associates PIDs withindividual packetized datastreams that constitute a program and is partof the SPG. The SPG may also contain additional information, e.g. packetassembly information, supporting the recovery of program guide data fromthe input transport stream.

Controller 115 also configures unit 45 using Control signal C to selectthe data packets comprising the DVD program guide (DPG) informationderived from DVD storage device 90 via interface 95. Unit 45 matches thePIDs of incoming packets in the packet datastream from interface 95 withPID values pre-loaded in control registers within unit 45 by controller115. Controller 115 acquires a full DPG by accessing and assembling theDPG packets that are identified and captured by unit 45.

A similar process is followed in acquiring Internet program guide (IPG)information from Internet server 83 or from Internet connection service87 by telephone line communication via modem 80. In acquiring the IPG,data identifiers analogous to or the same as the PIDs used in acquiringthe SPG or DPG are matched with identifiers pre-loaded by controller115. The matching function may be performed either within unit 80 or bycontroller 115. The process for acquiring program guide information isexplained in greater detail in the description of FIGS. 4-6.

The SPG, DPG and IPG information acquired by controller 115 is merged byprocessor 25 to form a program guide for display incorporating selectionoptions allowing a User to initiate Email, telephone, Internet access,fax and video-phone functions. In merging the data, the acquired SPG,DPG and IPG information is collated into two levels of hierarchy termedtheme and topic and redundant program guide information is eliminated. Atheme, for example, may include categories such as movies, sports,weather, arts, documentaries, news, etc. A topic is a category within atheme, for example, a movie theme category may have topics including,comedy, thriller, horror, science fiction, romance, adult entertainment,etc. Different or additional levels of hierarchy may be used incollating the acquired SPG, DPG and IPG information involving criteriasuch as viewer age suitability, the period setting e.g. contemporary orhistorical, reviewer ratings etc.

A number of problems occur in collating the SPG, DPG and IPGinformation. The SPG, DPG and IPG information, being from differentsources, may categorize programs by different themes and topics and mayuse a different sorting hierarchy. Further, the SPG, DPG and IPG datamay use conflicting, redundant or incompatible PIDs or other dataidentifiers for identifying individual data elements that compriseparticular program channel or guide content. Controller 115 creates amaster set of themes and topics mapping the SPG, DPG and IPG informationto a corresponding category in the master set. For example, the masterset may contain an encompassing topic-theme of ‘movies-comedy’ to whichis mapped both, a) the DPG topic-theme of ‘movie-parodies’, and b) theIPG Internet topic-theme of ‘movie-synopsis index’ (an index of webpages). In collating the guide information, controller 115 determinesthe topic and theme categories of the data in the SPG, DPG and IPG frompre-determined theme-topic codes. The SPG, DPG and IPG theme and topiccodes together with equivalence mapping information for converting codesof one service provider, to those of another, are acquired from the SPGor User defined data input to processor 25 or are pre-stored in internalmemory within controller 115. Controller 115 assembles the collated SPG,DPG and IPG packets according to the categories defined by the masterset of themes and topics. The assembled collated SPG, DPG and IPG datais stored by controller 115 in internal memory for use in forming acomposite program guide for display.

Controller 115 also forms MPEG compatible non-displayed information,associated with the displayed composite program guide. The non-displayedinformation includes composite program map, conditional access andnetwork information. This non-displayed information is required tosupport identification, assembly and decoding of the packets comprisingthe composite program guide and the associated program content. Theconditional access information governs access to programs based uponUser entitlement. The network information defines physical networkparameters such as satellite transmission channel frequencies andtransponder channels, for example.

Controller 115 forms composite program map information for the compositeprogram guide that maps the SPG, DPG and IPG themes and topics to themaster set of themes and topics. The composite program map alsoassociates data identifiers (e.g. PID values) with individual packetizeddatastreams that constitute programs listed in the composite programguide. The composite program map information may also include adedicated indicator to denote that a particular program has associatedInternet web page information available. In forming composite programmap information, controller 115 examines the SPG, DPG and IPGinformation for data identifier omissions, redundancies and conflicts.Controller 115 re-numbers existing data identifiers and creates new dataidentifiers as required to produce MPEG compatible program mapinformation for both the collated program guide information and theassociated program content.

Controller 115 also forms MPEG compatible conditional access informationand network information from corresponding information received in theSPG, DPG and IPG data. The conditional access information includes datasuch as encryption codes that govern access to programs that aredependent upon user entitlement. The network information definesphysical network parameters such as satellite transmission channelfrequencies, transponder channels, and Internet access parametersassociated with the composite program guide for display. The compositeprogram map, conditional access and network information supportsassembly, decoding and display of the program content available from thesatellite, storage and Internet server sources as well as the compositeprogram guide.

Controller 115 also includes additional linking data in thenon-displayed composite program map, conditional access and networkinformation. The additional linking data supports the User selectablefunctions such as Email, telephone, Internet access, fax, video-phone,channel tuning, program recording and home control functions. Homecontrol functions may support User control of lighting air conditioning,heating and burglar alarm operation, for example. The additional linkingdata associates access data, both with data identifiers (e.g. PIDs) ofrequested data, and with User selectable menu options in the displayedcomposite program guide. The access data includes identification codes,communication protocol codes, conditional access codes, Internet accesscodes e.g. URL codes for web page and Email access as well as telephoneand fax numbers. The access data enables processor 25 to communicatewith external devices.

In order to generate the composite program guide for display, controller115 retrieves the assembled and collated SPG, DPG and IPG packet datapreviously stored in internal memory. Controller 115 both converts theretrieved data to pixel data and formats the converted data for storagein a pixel representative memory map contained in display processor 70.In addition, controller 115 creates User selectable menu options (forUser selection of Email, fax etc.) in pixel data form for incorporationin the unit 70 pixel memory map. Controller 115 stores the formattedSPG, DPG and IPG pixel data together with the generated option pixeldata in the unit 70 pixel map to form the composite program guide fordisplay.

The composite program guide, combining the SPG, DPG and IPG data andUser selectable options, is formatted to be compatible with the linkingdata in the non-displayed program guide information. For example, a Userselectable option in the displayed guide (e.g. for a telephone function)is associated, both with access data for the function (e.g. a telephonenumber), and with data identifiers (e.g. PIDs for data packets oftransmitted and received telephone messages).

Display processor 70 converts the stored and formatted program guidedata into conventional luminance and chrominance components. Theluminance and chrominance components, together with timing data providedby controller 115, are processed by processor 70 in a conventionalmanner to form an NTSC signal for display on NTSC compatible imagereproduction device 75 e.g. a television or video monitor. Processor 70may, in another embodiment, provide RGB output data for display by anRGB compatible reproduction device or a high definition television.

Controller 115, in conjunction with processor 55, forms an MPEGcompatible datastream of compressed video and audio data containing thecomposite program guide and program content. Processor 55 separatessystem information including timing, error and synchronizationinformation from the datastream from unit 45 and diverts it for use bycontroller 115. Controller 115 applies the system information incontrolling processor 55 to provide re-synchronized, collated programand composite program guide data together with synchronization and errorindication information for use in subsequent program content datadecompression by decoder 65. The composite program guide data providedby processor 55 combines the SPG, DPG and IPG data and User selectableoptions in a manner compatible with the program map linking informationas previously described. The program content data provided by processor55 is decompressed by MPEG decoder 65 to provide video pixel data andaudio output data to processor 70. Display processor 70 processes thevideo pixel data and audio output data to be suitable for reproductionby unit 75 as previously described. FIG. 2 shows an exemplary displayedcomposite program guide. Menu features 833-850 show program services andfunctions. Menu features 833 and 835 show program channels which may beinvoked and displayed upon highlighting of the corresponding menufeature using a User selection control such as a remote control directedcursor. If a User highlights feature 833 with the cursor, i.e. selectsmenu option 833, for example, processor 25 tunes to television channel107 (A&E™) and displays it on unit 75 using the composite non-displayedprogram guide information to determine the function activated andassociated tuning information (channel frequencies etc.). Similarly, ifa User highlights feature 837, processor 25 tunes to receive radiochannel FM 13 for audio output on unit 75. Upon highlighting features840-850, corresponding to Email, telephone, fax and DVD record/playbackfunctions respectively, additional function specific menus becomedisplayed providing further User selection options. Such functionspecific menus may provide a User with the ability to edit, store anddelete access information including, for example, telephone numbers,Email addresses, Internet addresses, credit card numbers and additionalconditional access data.

If a User highlights menu features 860-870 specific function tasks areinitiated. Upon a User highlighting feature 860, for example, a furthermenu is displayed prompting the User to enter an Email message to besent to John Smith at his home via an Internet Email address retrievedfrom the composite non-displayed program guide information. Similarly,in response to a User highlighting feature 865, for example, controller115 (FIG. 1) retrieves Jean's home telephone number from internal memoryusing the composite non-displayed program guide information. Further,controller 115 establishes telephone communication, via modem 80, withJean at her home by dialing Jean's home telephone number. Also, upon aUser highlighting feature 870, for example, the movie ‘Star Wars™’ isre-played from DVD unit 90 (FIG. 1). The communication between processor25 and DVD unit 90 is established with access data retrieved from memorywithin controller 115 using the composite non-displayed program guideinformation.

In addition, the program guide may include one or more icons, such asicon 873 (FIG. 2) depicting a home, for example, to indicate whetherInternet information such as a ‘home page’ is available for a particularprogram. Further, icon 873, in FIG. 2 may change color e.g. from whiteto green to indicate Internet information is available for a particularprogram. Alternatively, icon 873 may be a pop-up icon which appears asan indication that Internet information is available for a particularprogram. The displayed program guide may be formed to enable a User torequest Internet information on a particular program by highlighting theprogram followed by highlighting the pop-up icon, for example. Home pageicons that are present when Internet information is available may alsolocated within or adjacent to program icons, e.g. icon 859. Further, thehome page icon may change color upon User selection of the informationby highlighting the home page icon.

Although Internet information may be retrieved upon highlighting a webpage icon such as icon 857, in FIG. 2, this is exemplary only. Retrievalof Internet information may also be initiated in a variety of otherways. A user may retrieve available Internet information relating to aprogram, by highlighting a program icon such as ‘Seinfeld™’ using icon859 followed by highlighting Internet icon 810, for example.

Upon User selection of a composite program guide function, controller115 (FIG. 1) determines and applies the access data associated with bothrequest and response operations involved in the selected function.Controller 115 determines the access data required for the request andresponse operations from the previously formed non-displayed compositeprogram map, conditional access and network information.

Processor 25 acquires information, such as web page data, in response toa User request, in a number of ways, including, for example:

a) In a first configuration, processor 25 accesses web page data that iscontinuously transmitted in the satellite broadcast received fromdecoder 30,

b) In a second configuration, processor 25 acquires web page data thatis transmitted in the satellite broadcast received from decoder 30 inresponse to an information request to a service provider via telephoneline, and

c) In a third configuration, processor 25 both requests information andreceives response information on the same communication link e.g. on thetelephone link to server 83.

First Configuration of Processor 25

In the first configuration, web page data selected by a User via thedisplayed program guide is continuously transmitted within the transportdatastream input to processor 25 from decoder 30. In this configuration,the composite program map information contains predetermined PID valuesfor the requested web page. Consequently, the requested web page data isretrieved from the input transport stream using the composite programmap information without the need for controller 115 to communicate witha service provider via modem 80. In this configuration, the webinformation available to a User is limited to the specific informationthat a service provider continuously transmits to processor 25 usingdedicated transmission bandwidth. However, this configuration is simpleand offers quick web page access (since the web data may be storedlocally at the encoder by the service provider). This configuration alsominimizes the service provider burden of data acquisition and eliminatesthe need for processor 25 to communicate web page request information toa service provider.

The web page information, encoded in HTML™ and Java™, is packetized andformatted in an encoder by the service provider for incorporation intothe MPEG transport datastream for transmission. FIG. 3 shows a dataformat, according to the invention, for packetizing Internet data fortransmission within an MPEG compatible datastream. A sequence ofHTML™/Java™ web pages (705-720 of FIG. 3) is formed by the encoder intonon-compressed packets with ancillary information and HTML™/Java™ data(725). The ancillary information includes PID values, a packet countvalue, and individual web page size (e.g. number of bytes or image pixelsize). The ancillary information may also include: a flag to indicatethat a particular transport packet contains web page information; astart code; a web page identification code; an error correction code anda timing parameter suitable for synchronizing web page Internetinformation with an associated video or audio program. The web page flagmay be used to facilitate identification and separation of the web pageinformation from the MPEG compressed video data. Further, one or moreelements of the web page ancillary data may be included within Userdefinable elements of the MPEG transport syntax, such as within thetransport header, or it may be included along with the web pageinformation in the MPEG transport data payload.

The response web page information, including a predetermined PID value,is incorporated in the MPEG compatible transport datastream input toprocessor 25 (FIG. 1) by the service provider. The response channelpredetermined PID value is also prestored in controller 115 internalmemory and incorporated in the composite program map information. As analternative, the response data PID value and associated program map datamay be encoded, for example, in a Channel Information Table (CIT) in ahigh definition television (HDTV) signal encoded according to theDigital Television Standard for HDTV Transmission of Apr. 12, 1995,prepared by the United States Advanced Television Systems Committee(ATSC). In such a case, one or more specific pre-determined programchannels may be designated to convey web page response information.Further, the PID values of the program channels may be conveyed in a CITin the composite program map information, for example.

Controller 115 derives the predetermined PID value corresponding to therequested web page response information from the stored compositeprogram map information and loads it into control registers within unit45. Unit 45 matches the PIDs of incoming packets of web page responsedata in the transport datastream from decoder 30 with the PID valuepre-loaded in the unit 45 control registers. The packets with PID valuesmatching the pre-determined web response PID value are identified as webpage response data and are provided by unit 45 to a dedicated buffer indecoder 55. The dedicated buffer in transport decoder 55 holds responsedata to be decoded by processor 60.

Processor 55 derives system information including timing, error andsynchronization information from the datastream from unit 45 andprovides it to controller 115. Controller 115 applies the systeminformation in directing processor 55 to provide re-synchronized webpage response data from the dedicated buffer in decoder 55 toHTML™/Java™ processor 60. Processor 60 decodes the HTML™ and Java™encoded web response information and provides web page imagerepresentative pixel data for storage in memory within controller 115.Although processor 60 is shown as a separate processor in FIG. 1, it mayalso be implemented within the software of controller 115. Processor 60comprises the processing functions of a special web browser, includingJPEG decompression and Java decoding such as involved in the operationof Netscape Navigator™, for example.

Program content data e.g. a User selected television program channel,within the MPEG compatible transport datastream from decoder 30, is alsodecoded into pixel representative data by processor 25 in addition tothe web page response data. For this purpose, controller 115 determinesthe PID value of the selected television channel program from thecomposite program map information and loads it into control registerswithin unit 45. Unit 45 matches the PIDs of incoming packets of selectedtelevision channel program data in the transport datastream from decoder30 with the PID value pre-loaded in the unit 45 control registers. Thepackets with PID values matching the pre-determined selected televisionchannel program PID value are identified and provided by unit 45 to adedicated application buffer in decoder 55.

As previously described for the web page response data, processor 55derives system information including timing, error and synchronizationinformation from the datastream from unit 45 and provides it tocontroller 115. Controller 115 applies the system information indirecting processor 55 to provide re-synchronized program channelcontent data from the application buffer in decoder 55 to MPEG decoder65. The MPEG compatible program channel content data is decompressed byMPEG decoder 65 to provide video pixel data and audio output data todisplay processor 70. The video pixel data from decoder 65 is stored ina pixel representative memory contained in display processor 70.

Controller 115 retrieves the web page image pixel data from internalmemory and formats it for storage as an overlay in the pixelrepresentative memory contained in display processor 70. As such amerged display combining the web page response data and program channelcontent is formed within the pixel memory of processor 70. The relativeproportions and sizes of the web page image and channel content imagewithin the resultant composite image, formed in the processor 70 pixelmemory, may be varied by controller 115 in response to internalprogrammed instruction or external, e.g. User, command. The relativeproportions may be varied so that either the web page image or channelcontent image contributes between 0-100% of the resultant compositeimage.

In order to adjust the proportion of the composite image contributed bythe web page data, controller 115 scales the web page image pixel databy a conventional interpolation process. Alternatively, the data may bescaled by a separate video processing integrated circuit operating inconjunction with controller 115. The resulting scaled web page image isstored within the processor 70 pixel memory by controller 115. Thestored web page image represents an overlay image with respect to theprogram channel content image. In order to adjust the location of theweb page image data within the composite image, controller 115determines the addresses corresponding to the desired memory locationsfrom internal memory map data and stores the scaled web page image dataat the desired memory locations. As previously explained, displayprocessor 70 converts the formatted composite image data intoconventional luminance and chrominance components. Further, processor 70processes the luminance and chrominance components, together with timingdata provided by controller 115, in a conventional manner to form anNTSC signal for display on NTSC compatible image reproduction device 75.

Second Configuration of Processor 25

In the second configuration, processor 25 of FIG. 1 acquires web pagedata that is transmitted in the satellite broadcast received fromdecoder 30 in response to an information request to a service providervia a telephone line. Upon a User requesting web page data, e.g. byhighlighting web page icon 857 in FIG. 2, controller 115 (FIG. 1) usesthe request access data (telephone number, requested web page identifiercode (e.g. URL) and conditional access data) to establish communicationwith the satellite broadcast service provider.

Prior to establishing communication with the service provider,controller 115 determines from conditional access information whetheraccess to the requested web page information is authorized.Authorization may be determined directly from the program guideconditional access information or indirectly from a User entitlementdevice such as a smart card (not shown to simplify the drawing) withinprocessor 25. If access is authorized, controller 115 establishestelephone communication with the satellite broadcast service provider bydialing a telephone number via modem 80 and transmitting requestinformation e.g. requested web page identifier code (such as a URL) anduser entitlement code. The service provider incorporates the requestedweb page information in the transport datastream transmitted toprocessor 25 via antenna 10, processor 20 and decoder 30. Controller 115uses the response access data (PIDs of the web page data, responseprogram channel number and transponder number) to identify and assemblethe web page packets in the transport stream as described for the firstconfiguration of processor 25.

The PID values of the response web page information and correspondingprogram map information may be communicated between service provider andprocessor 25 in a variety of ways and in a variety of data formats. ThePID values and program map information may be conveyed, for example, inaccordance with proprietary or custom requirements of a particularsystem such as within MPEG user definable data elements or withinnon-MPEG data such as within the vertical blanking interval (overscanregion) of a broadcast television signal. Further, the PID valuesallotted to the web information may also be transmitted to processor 25in supplemental program guide information. As another alternative, thePID values to be used for response data may be determined by a serviceprovider from information transmitted from processor 25.

Third Configuration of Processor 25

In a third configuration, processor 25 both requests information andreceives response information on the same communication link e.g. on thetelephone link to server 83 or connection service 87, via modem 80. Inthis configuration, controller 115 requests Internet web pageinformation by highlighting icon 857 (FIG. 2), for example. Whereuponcontroller 115 (FIG. 1) uses request access data (telephone number andURL code and conditional access data) to establish Internet access andrequest web page data at the URL address via modem 80 and server 83.Controller 115 determines whether the requested Internet access isauthorized from conditional access or smart card User entitlementinformation as described in connection with the second configuration ofprocessor 25. If authorized, controller 115 establishes telephonecommunication with a service provider via server 83 by dialing atelephone number using modem 80 and transmitting the Internet URLaddress code and user entitlement code, for example, as previouslydescribed. Controller 115 uses response access data (includingTransmission Control Protocol/Internet Protocol (TCP/IP) identificationdata) determined from the composite program map information to identifyand assemble the web page TCP/IP packets containing the web page HTMLand associated JAVA data (and other data e.g. JPEG, GIF, TIF type data)in the response datastream from server 83.

The response web page TCP/IP packets are buffered within modem 80 andprovided to HTML™ processor 60 under command of controller 115.Processor 60 decodes the HTML™ and Java™ encoded web responseinformation and provides web page image representative pixel data forstorage in memory within controller 115. Controller 115 retrieves theweb page image pixel data from internal memory and formats it forstorage as an overlay in the pixel representative memory contained indisplay processor 70 for reproduction by unit 75 as a merged display, aspreviously described. In this configuration, processor 25 supports fullInternet access via server 83 using the displayed program guide. Forexample, upon a User highlighting icon 810 followed by icon 830 (FIG. 2)controller 115 (FIG. 1) executes web page browser functions and displayseither a custom web page browser or a standard browser display such asNetscape Navigator™ through which full Internet access is available.

Alternatively, in the third configuration, processor 25 may support alimited Internet service. In this case, access to the Internet networkvia server 83 is under the control of a service provider that allowsonly indirect Internet access. The service provider provides collatedweb page information for display compatible with the displayed compositeprogram guide. The service provider stores a limited number of web pageslocally within server 83 that are accessible by processor 25 using thecomposite program map information which provides an index to theavailable web pages and their corresponding predetermined PIDs.Alternatively, the service provider may alter the selection of web pagesavailable from server 83 and periodically provide updated compatiblesupplemental program guide information to processor 25 via the satellitebroadcast datastream.

The supplemental program guide information enables processor 25 to forman updated displayed guide together with compatible program map andother access information enabling a User to access the updated webinformation. By storing the web page Internet information locally inserver 83 the service provider retains control of the Internet contentavailable to a User and is able to bill the User for the materialprovided. Also, the local storage of the web page information in server83 provides a User with faster access to the information without thefull delay associated with normal Internet access. Further, the burdenon processor 25 of communicating information requests to externaldevices is minimized in that only a limited quantity of Internetinformation may be requested and processor 25 need only communicate withlocal servers such as server 83. It is to be noted that modem 80 mayalso be a wide bandwidth communication modem such as a cable modem. Inwhich case, processor 25 may decode both web page data and broadcastvideo program data for display from a cable program source via modem 80.

Controller 115 employs the method shown in FIG. 4 to produce a displayedprogram guide by processing and formatting received program guideinformation that already includes User selection menu options. Theprocess of FIG. 4 does not require processor 25 to form User selectionmenu options and may be employed by processor 25 in its firstconfiguration, for example. In step 205, following the start at step200, processor 25 receives a transport datastream from decoder 30 thatincorporates User selectable menu options for display as part of thedisplayed program guide. The User selectable options support Userinitiation of communication functions such as Email, telephone, Internetaccess, fax, video-phone, channel tuning, program recording and homecontrol functions.

The data received in step 205 also includes additional linking data inthe program guide information. The additional linking data comprisesprogram map, conditional access and network information and associatesaccess data with the User selectable menu options in the displayedprogram guide. The access data includes, identification codes,communication protocol codes, conditional access codes, Internet accesscodes e.g. URL codes for web page and Email access as well as telephoneand fax numbers. The additional linking data enables processor 25 toassemble, decode and display the program content and program guideinformation in the transport stream from decoder 30. The access dataenables processor 25 to communicate with external devices and includesdifferent address representative codes corresponding to addresses ofdifferent information sources. In step 210, controller 115 usespredetermined linking data PID values stored in internal memory indirecting processor 25 to identify and capture the linking and accessdata from the received program guide information. The captured linkingdata is assembled, formatted and stored by controller 115 in internalmemory in step 215. Also, in step 210, additional linking data such asInternet or Email addresses or telephone numbers may be entered by aUser via an entry device such as a remote control unit and theadditional data is incorporated in the received linking data bycontroller 115.

The program guide information containing the User selectable options, isformatted for display by controller 115 in conjunction with displayprocessor 70 within processor 25 in step 220, as previously described inconnection with FIG. 1. In step 225, display processor 70 converts thestored and formatted program guide data into conventional luminance andchrominance components. The luminance and chrominance components,together with timing data provided by controller 115, are processed byprocessor 70 for display on reproduction device 75. The process of FIG.4 terminates at step 230.

Controller 115 (FIG. 1) employs the method shown in FIG. 5 to produce aprogram guide in a video decoder from information received from aplurality of sources. The formed guide supports User selectablecommunication functions e.g. Internet access, Email, fax etc. In step305, following the start at step 300, controller 115 acquires satelliteprogram guide (SPG) information from the satellite broadcast transportstream received by processor 25 from decoder 30. In step 310, controller115 acquires DVD program guide (DPG) information from storage device 90via interface 95. Controller 115 acquires, collates and formats the SPGand DPG by accessing and assembling respective data packets to produceSPG and DPG representative pixel data for storage as a composite programguide in the unit 70 pixel map, as previously described in connectionwith FIG. 1. The SPG and DPG information includes linking and accessdata in the form of program map, conditional access and networkinformation. In other configurations, processor 25 applies theprinciples detailed herein to form a composite program guide includingprogram guide information derived from a source such as a terrestrialbroadcast source, a cable broadcast source, a computer source, a radiotransmission source and a source accessed via telephone lines.

In step 315, controller 115 creates User selectable menu options fordisplay (for User selection of Internet access, Email, fax etc.) inpixel data form for incorporation in the unit 70 pixel memory map. Instep 315, controller 115 also creates User determinable menu optionsthat enable a User to customize his program guide to include an iconthat performs a specific User requested function, for example, a Usermay require an icon that accesses a specific Internet site or results ina display of all received messages. Controller 115 responds to commandsentered via a data entry device e.g. a remote control unit or keyboardin creating the User determinable menu option in accordance withprogrammed instructions.

Controller 115, in step 320, examines the SPG and DPG information fordata identifier (e.g. PID) omissions and conflicts. In step 325,controller 115 re-numbers existing data identifiers and allocates newdata identifiers as required to produce compatible program mapinformation for both the collated program guide information and theassociated program content. In step 330, controller 115 forms compositeprogram map, conditional access and network information for thecomposite program guide in the manner described in connection with FIG.1.

The composite program map is formed to enable processor 25 to performthe communication functions selectable via the composite program guide.For this purpose, the composite program map associates a communicationfunction PID and menu option (e.g. web page, Email, fax icon) with thedifferent address representative codes corresponding to the addresses ofthe different information sources. In step 330, controller 115 alsoincorporates User entered data into the composite program map,conditional access and network information. This data may include itemssuch as an Email address, a telephone/fax number, an Internet web pagelink address, a credit card number etc. The User enters this data toprocessor 25 via a device such as a remote control or keyboard.Controller 115, in step 335, formats the SPG and DPG pixel data togetherwith the menu option pixel data in the unit 70 pixel map created in step315 to form a composite program guide for display.

The composite program guide information containing the User selectablemenu options is formatted for display in step 340, and output in step345 as previously described in connection with FIG. 1. The process ofFIG. 5 terminates at step 350.

Controller 115 (FIG. 1) employs the process of FIG. 6 to automaticallyacquire and collate program guide information from a plurality ofsources to form a composite program guide for display. In step 405,following the start at step 400, controller 115 acquires and storessatellite program guide (SPG) information from the satellite broadcasttransport stream received by processor 25 from decoder 30. Controller115, in step 415, automatically initiates communication with DVD storagedevice 90 (FIG. 1), via interface 95. The communication is initiatedupon power-up of processor 25 in response to pre-stored hardwareconfiguration information defining the peripheral devices that areattached to processor 25 and the associated communication protocols.This information may be contained within the received program guideinformation, or may be stored within processor 25 at manufacture, or maybe determined locally by processor 25 or may be determined through acombination of these methods. The local determination of hardwareconfiguration by processor 25 may be accomplished either by peripheralinterrogation initiated by controller 115, or by User data entry ofhardware configuration data.

In alternative embodiments, communication may be automatically initiatedupon conditions such as, a) User command via a program guide optionselection, for example, b) peripheral interrogation initiated bycontroller 115 on a periodic or intermittent basis, or c) detection of anew or changed electrical connection of processor 25 to a peripheraldevice such as DVD device 90.

Controller 115 initiates communication with DVD unit 90 via interface 95using communication protocol codes, identification codes, entitlementcodes and conditional access codes retrieved from the access data withinthe received program guide information. In step 420, controller 115directs processor 25 to acquire and assemble the DVD program guide (DPG)information derived from DVD storage device 90 via interface 95 in themanner previously described in connection with FIG. 1. In step 425,controller 115 collates the SPG and DPG information by theme and topicby mapping the SPG and DPG information to corresponding theme and topiccategories in a master set, also as described in connection with FIG. 1.Further, in step 425, controller 115 collates the SPG and DPGinformation by source and allocates a different color attribute toprograms and program icons from different sources. In addition,controller 115 creates menu options permitting a User to sort by sourceand color.

FIG. 7 shows a black and white representation of a color Program Guidedisplay format, according to the invention, showing menu options createdby controller 115 permitting a User to collate programs by source andcolor attribute. Source icons 905-925 are associated with off-airbroadcast, cable, radio, satellite and storage (e.g. DVD source90—FIG. 1) respectively. Source icons 930-950 are associated with Email,telephone, videophone, fax and Internet function sources respectively.Upon a User highlighting source icon 905, for example, a program guideis displayed showing off-air broadcast programs and associated icons.Similarly, upon a User highlighting source icon 930, for example, aprogram guide is displayed showing Email icons via which a User mayactivate menus for initiating composition and sending of Email messagesand reading and deleting of messages received.

Icon 900 is a “rainbow” sort icon showing a spectrum of discrete colorblocks represented by shades of gray in the black and white programguide depiction of FIG. 7. The color choices of icon 900 mayalternatively be arranged as a continuous color spectrum or selectedrange of colors in a single or a number of discrete color blocks. Upon auser highlighting a particular color within icon 900, programs from thesource attributed with that particular color are displayed. For example,assuming in step 425 controller 115 attributes the color purple to theDVD source device 90, then upon a user highlighting the color purplewithin icon 900, the movies available from DVD device 90 becomedisplayed as a program guide. Alternatively, the color collation schememay be used to identify programs by other criteria than source. Colormay be used as an attribute to identify programs by theme or topic, forexample, in which case a display of movies available for viewing fromall sources may be identified by highlighting a red color within icon900, for example. In addition, program guide data may be collated byattributes other than color. For example, programs from differentsources may be attributed with different types of shading or differenticon shapes and geometrys.

Continuing with the process of FIG. 6, in step 430, controller 115 formsa composite program guide for display from the collated SPG and DPGinformation in a manner similar to that described in connection withFIG. 1. Controller 115 also, in step 425, creates associated Userselectable menu options for display including the User selectableprogram guide options for sorting by source and color. The created menuoptions are incorporated by controller 115 in step 430 in a compositeprogram guide for display as exemplified in FIG. 7. In step 435,controller 115 formats the composite program guide information fordisplay as previously described in connection with FIG. 1. The processof FIG. 6 terminates at step 440.

Controller 115 (FIG. 1) employs the process of FIG. 8 to acquire webpage information requested by a video receiver User via a selection madefrom options on a displayed program guide. In step 505, following thestart at step 500, controller 115 retrieves access data in the form of atelephone number and Internet URL code, for example, from memory inresponse to a User selection of a web page made via a displayed programguide. The access data associated with the particular User selection isdetermined from a program guide database using program map informationthat links all data associated with a particular program or programguide function.

In step 515, controller 115 directs processor 25 to establish a requestcommunication link with server 83 by dialing the retrieved telephonenumber using modem 80. Also, in step 515, processor 25 encodes andtransmits additional access data such as the Internet URL code using theprotocol required for communication on the request communication link.The required protocol is determined from the program map information. Instep 520, controller 115 directs processor 25 to receive and decode aninput signal received on a response communication link. Controller 115directs processor 25 in identifying and retrieving the response web pageinformation from the input signal in steps 525 and 530. Differentmethods of retrieving response data from the input signal are employedby processor 25 in steps 525 and 530. The selected method depends onwhether or not the response communication link is the same link used forthe web page data request. The methods used in identifying andretrieving the response data are similar to those previously describedin connection with the three configurations of processor 25. Controller115 applies the appropriate configuration method in identifying theresponse web page data in the input signal, in step 525. For thispurpose, controller 115 uses data identifiers determined from programmap information that associates the identifiers with the User programguide selection. Controller 115, in step 535, formats the response webpage information for display and the FIG. 8 process ends at step 540.

Controller 115 (FIG. 1) employs the process of FIG. 9 for decoding bothinput Internet information and compressed video data to form a compositevideo output for display. Following the start at step 600, controller115, in step 605, determines packet identifiers for User requestedInternet data and compressed image data from program map information. Instep 607, controller 115 determines whether access to the compressedvideo data and the requested Internet data is authorized fromconditional access or smart card User entitlement information aspreviously described in connection with the third configuration ofprocessor 25.

If access is authorized, controller 115, in step 610, identifies the webpage TCP/IP packets containing the web page data in a responsedatastream from server 83. Similarly, if access is authorized,controller 115, in step 615, identifies the compressed video datapackets containing a User selected video program in an input transportstream from decoder 30 to processor 25. Controller 115 identifies theweb page and compressed video data packets in a similar manner to thatdescribed in connection with FIG. 1.

In step 617, controller 115 directs processor 25 (FIG. 1) to decryptInternet or compressed video data if it is encrypted. Controller 115 instep 620, directs processor 25 in decoding the identified Internet webpage data using HTML™ processor 60. Controller 115 in step 625, directsprocessor 25 in decompressing the identified compressed video data usingMPEG decoder 65. The resultant decoded web page data and decompressedvideo data is merged, formatted and displayed on unit 75 using displayprocessor 70 under the direction of controller 115 in step 630. Theprocess of FIG. 9 terminates at step 640.

The architecture of FIG. 1 is not exclusive. Other architectures may bederived in accordance with the principles of the invention to accomplishthe same objectives. Further, the functions of the elements of processor25 of FIG. 1 and the process steps of FIGS. 4-6, 8 and 9 may beimplemented in whole or in part within the programmed instructions of amicroprocessor. In addition, the principles of the invention apply toany form of MPEG or non-MPEG compatible electronic program guide.Further, the principles of the invention apply to communication on anyform of communication link including via cable, infra-red, radio,microwave, and via a computer network. In addition, it is to be notedthat the formation of the composite program guide as described hereinmay be performed at a location remote from a video receiver and accessedby the receiver via a communication network.

1. In a video decoder system for receiving program guide informationfrom a first source containing a first code identifying a programcategory, a method for collating program guide information from aplurality of sources, comprising the steps of: converting said firstcode to a second code in accordance with equivalence mapping informationfor allocating a category in a master set of program categories to saidreceived program category; converting a third code to a fourth code, thethird code being from a second source and identifying a particularprogram category, in accordance with equivalence mapping information forallocating a category in the master set of program categories to theparticular program category; sorting and merging program guideinformation from said first source and said second source, according tosaid master set of program categories; and displaying said sorted andmerged program guide information, wherein sorting and merging programguide information according to said master set of program categoriescomprises sorting and merging the second code and the fourth code.
 2. Amethod according to claim 1, further including the step of receivingsaid equivalence mapping information.
 3. A method according to claim 1,further including the step of retrieving said equivalence mappinginformation from said program guide information from said first source.4. A method according to claim 1, wherein said equivalence mappinginformation is pre-stored in decoder memory and said method includingthe further step of retrieving said equivalence mapping information fromsaid decoder memory.
 5. The method of claim 1, wherein sorting andmerging program guide information according to said master set ofprogram categories comprises sorting and merging the second code.